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INTELLIGENT MICROSENSOR MODULE 


5 CROSS-REFERENCE TO RELATED APPLICATIONS 

The present application claims the benefit of U.S. Provisional Patent 
Application No. 60/302,563 filed 2 July 2001, which is hereby incorporated by 
reference. 

10 BACKGROUND OF THE INVENTION 

The present inventions relate to intelligent microsensors. More 
particularly, the present inventions relate to intelligent microsensors that can fuse 
data streams from a variety of sources and locally process the data to determine the 
current state of the environment in which the intelligent microsensor is placed. 

15 Microsensors are used in the prior art to detect certain parameters and to 

report the raw data detected to a remote location for processing. Some dedicated 
purpose sensor units, such as shown in United States Patent No. 5,511,553 to 
Segalowitz (the *553 patent), are used to detect multiple physiological parameters 
from a patient. Some embodiments of the '553 patent describe the data detection 

20 and processing as being completed "on the patient" at the patient's end. However, 
the invention of the *553 patent is not readily neconfigurable for other uses. 
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What is needed is a general purpose smart sensor that can fuse data from 
multiple types of sensors, processing the sensor data locally. What is further 
needed is an intelligent smart sensor module which can analyze the locally 
S processed data and, if desired, react to the resultant data to adjust the environment 
of the smart sensor module and/or forward the resultant data to a remote location. 
What is additionally needed is an intelligent microsensor package that can be 
standardized and easily adapted and/or reconfigured for multiple different uses. 
These objects, and others, are satisfied by Applicant's present inventions disclosed 
10 here below. 
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SUMMARY OF THE INVENTION 

One embodiment of the present invention relates to a unique sensing 
technique. Other embodiments include unique methods, systems, devices, and 
apparatus for sensing one or more characteristics. A further embodiment of the 
5 present invention is directed towards a modular, general purpose sensor unit. The 
modular sensor unit includes a sensor array layer, a processor and control layer, 
and a power layer. The sensor array layer receives and conditions data from at 
least two sensors which can be the same type or different types. The general 
purpose intelligent processor and control layer processes the conditioned data and 
10 produces output data derived from the conditioned data, which is different, at least 
in part, from the conditioned data. Additionally, the processor and control layer 
includes a reprogramimable memory for storing application specific software to 
control the operation of the processor and control layer. The power layer provides 
power to the sensor array layer and the intelligence and processor control layer. 
IS The sensor array layer, the processor and control layer, and power layer are layered 
to form a unitary smart sensor module. 

In some other embodiments, a conmiunications layer is additionally 
included. The communications layer can be used to receive new software to 
reprogram the smart sensor module for a different application. In another 
20 embodiment, a network of smart sensor modules is provided. 

One object is to provide a unique sensing technique. 
Another object is to provide a unique method, system, device, or apparatus 
for sensing one or more characteristics. 

Further embodiments, forms, benefits, aspects, features, objects and 
25 advantages of the present invention will be apparent from the following 
description. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is illustrated by way of example, and not by way of 
limitation, in the figures of the accompanying drawings and in which like reference 
numerals refer to similar elements and in which: 
5 HG. 1 shows a block diagram of a smart sensor module in accordance with 

one embodiment of the present invention. 

FIG. 2 shows one particular embodiment of the discrete layers used to 
fabricate the smart sensor module of the present inventions. 

FIG. 3 shows the basic smart sensor module interfacing with an application 
specific passive layer. 

FIG. 4 shows a smart sensor architecture including an additional process 
control layer disposed in contact with the passive layer. 

FIGS. 5-7 show an example of an optically implemented biosensor using 
the general purpose smart sensor module and a passive layer. 

FIGS. 8 and 9 show an optically implemented physical sensor in 
accordance with one embodiment of the present inventions. 

FIG. 10 shows a more detailed block diagram of one particular embodiment 
of the general smart sensor system architecture for a general purpose smart sensor, 
such as the smart sensor of FIG. 1 or of FIGS. 2-4. 

FIG. 1 1 shows a diagram of one particular embodiment of the 
communication system between a plurality of smart sensor modules and a remotely 
located central data management and master control node or station. 

FIG. 12 is a block diagram showing one specific hardware implementation 
of a general smart sensor in accordance with one embodiment of the present 
inventions. 

FIG. 13 shows an example of a portable device incorporating a smart 
sensor module in accordance with one embodiment of the present inventions which 
is useful as a portable health monitor. 
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FIG. 14 shows an example of a portable device incorporating a smart 
sensor module capable of sampling and locally analyzing a biological sample for 
the detection and identification of multiple genetic traits. 
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DESCRIPTION OF SELECTED EMBODIMENTS 
For the purposes of promoting an understanding of the principles of the 
inventions, reference will now be made to the embodiments illustrated in the 
drawings and specific language will be used to describe the same. It will 
5 nevertheless be understood that no limitation of the scope of the inventions is 

thereby intended. Any alterations and further modifications of the principles of the 
inventions as illustrated or described herein are contemplated as would normally 
occur to one skilled in the art to which the inventions relate. 

Certain embodiments of the present inventions relate to a smart sensor 
10 design that is very general in nature and is capable of performing nearly any 

sensing and data analysis task. The smart sensor device can fuse data streams from 
a variety of sources (sensors) and then locally determine the current state of the 
environment in which the smart sensor is placed. The resultant data, rather than 
raw data, is communicated to the outside world when the microsensor device is 
IS queried. 

Referring now to FIG. 1, there is shown a block diagram of a smart sensor 
module 10 in accordance with one embodiment of the present invention. The 
smart sensor module 10 includes an array of sensors 20 for sensing characteristics 
of the environment in which the smart sensor 10 is placed. Alternatively or in 

20 addition to a sensor array, physical connectors for sensor leads may be provided. 
The sensing elements included in array 20 can respond to a variety of external 
environmental stimuli in the form of physical parameters, chemical parameters or 
biological parameters. Physical sensors can include those that respond to 
temperature, pressure, shock, vibration, electric fields, magnetic fields, optical 

25 irradiation, particle radiation, thermal radiation, momentum, acceleration, flow, 
viscosity, density, mass, shear strain, conductivity, impedance, sound, ultrasound, 
etc. Chemical sensors can include those that respond to specific organic or 
inorganic chemical elements or compounds or complexes in liquid gas or solid 
phases. Biological sensors may include those sensors that respond to biologic 

30 compounds such as proteins, enzymes, antigens, antibodies and other DNA 
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fragments, genes or olignonucleotides. The foregoing lists are not meant to be 
limiting, as other sensors may be used as desired. The sensors may be either 
highly specific to the stimuli of interest or broad band, having non-uniform 
sensitivities to a broad range of external stimulus. 
5 Additionally, in one embodiment of the present invention, the sensors are 

fabricated on a single substrate and appropriately doped, coated and/or grouped 
with other sensors to yield the desired response. If desired, the sensors may be 
integrated as a hybrid system onto a single carrier which functions as a single unit. 
Additionally, physical connectors for sensor leads may be provided on the sensor 
10 layer. 

The sensor inputs are conditioned by the signal conditioning stage 25 and 
provided to the sensor fusion stage 30, which combines the data from multiple 
types of sensors. From the sensor fusion stage 30, the conditioned sensor provides 
the sensor data to the general purpose intelligent processing stage 40, which 
15 processes the conditioned sensor data in accordance with software within processor 
42. The software for each particular application of the smart sensor module can be 
tailored to the specific environment and application in which the sensor has been 
placed. 

A communications (Comm.) link 50 provides processed sensor data in the 
20 form of actionable information to a remote site. Additionally, raw sensor data can 
be forwarded to the remote site, if desired. For example, if audio is provided at the 
smart sensor, that raw audio input can be provided directly to a remote site, if 
desired. 

Further, a power supply 60 provides power to all of the different sensor 
25 module components. In the most preferred embodiment, at least the power source 
60, the general purpose intelligent processor 40 and the conununications link 50 
are provided in a single compact package. The sensor array 20 may be part of the 
monolithic smart sensor module 10 and/or may be separately chosen and fixed to 
the module 10, as will be described herebelow. The wireless conununications 
30 capability of the present inventions, along with the data fusion and intelligent on- 
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board analysis provides the end user station with processed, actionable data. As 
will be described below in connection with the examples, the flexibility of the 
modular design allows the user to interchange different sensor suites with 
associated control electronics and different communications boards as needed. 
5 Referring now to FIG. 2, there is shown one particular embodiment of a 

smart sensor module 100 of the present inventions, that includes layers each 
generally designated by reference numeral 101. Layers 101 are each formed with a 
corresponding substrate or carrier 101a. The smart sensor module 100 of the 
present embodiment is preferably integrated into a single unit to which any 
10 specialized sensor array layer can be added or interchanged. In the present 
embodiment, the structure of the module 100 is preferably a foundational 
architecture that allows biological, chemical and/or physical sensor arrays to be 
read, processed and handled using conmion electronics and processing layers 101. 
Accordingly, for the embodiment of module 100 shown in FIG. 2, layers 101 arc 
1 5 alternatively, and more specifically, designated by reference numerals 102, 104, 
106, and 108, as follows. Sensor module 100 of the present embodiment includes 
the power layer 102, the communication layer/networking processor 104, the 
intelligence and processor control layer 106 and the sensor layer 108 with different 
features 109, such as sources, detectors, actuators. In one embodiment, layers 102, 
20 104, 106 can be collectively used as a sensor subassembly 107 with which 

different types of sensor layers 108 can be exchanged. In the present embodiment, 
the hardware of the four layers of FIG. 2 can be identical for all sensor module 
applications, but can be differently progranmied by different software for such 
applications. Some applications additionally include a passive layer that is 
25 application specific. The passive layer interfaces with the sensor array layer 108. 
For such embodiments, layers 102, 104, 106, and 108 can provide a common 
subassembly relative to different interchangeable passive layers. 

The power layer 102 includes a power source 102a, preferably a device that 
can extract power from the operating environment and convert the energy to a 
30 useful electrical form to operate the other elements in the systems. The power may 
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be derived from forms of energy or potential energy, such as solar conversion, 
acceleration, pressure, temperature, radiation, RF waves, chemicals, piezo-electric 
or other means. An energy storage device such as a battery, flywheel or other 
means may be included with or as the primary power source. 
5 The communications layer 104, is preferably, but not limited to, a wireless 

conmiunication source based on high frequency radio, ultrasonic or optical 
modulation. Communication may be self-activated or it may respond to an RF tag 
or a small high frequency transceiver. The communication layer 104 can be on the 
same substrate or carrier 101a as the other components of the system. The 

10 communication protocol will allow for asynchronous or synchronous 

communication with other similarly configured smart sensors and with centralized 
base stations. In one preferred embodiment, the communications layer 104 adheres 
to the BLUETOOTH standard. Additionally the conmiunications layer 104 
includes the network protocol information. 

IS The intelligence and processor control layer 106 includes a low power 

processing unit 106a capable of cognitive and inferential thinking based on 
statistics and neural networks for processing. The processing unit 106a 
intelligently assimilates, integrates, and processes the data gathered by the sensors, 
to yield a useful actionable output. The intelligence layer 106 with its associated 

20 artificial intelligence allows the smart sensor module to "sift" information from the 
raw data being detected by the sensor layer 108. 

The processor 106a may be in the form of a neural network, a parallel 
processor or a serial processor. It may include adaptive learning algorithms, such 
as self-organization feature map (SOFM), adaptive resonance theory (ART), feed 

25 forward (FF) neural network, recurrent neural network (RNN) and/or Hopfield and 
bi-directional associative memory (BAM) learning techniques. Additionally or 
alternatively, rule-based systems (decision trees, expert systems, fuzzy sets, fuzzy 
logic, dynamic programming, etc.) and classical data gathering and processing 
techniques may be used. 
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The processor 106a and/or intelligence layer 106 may process the data or 
actions from other smart sensors. Further, the processor 106a may compare data to 
historical data or trends to determine an action based on that historical data or 
trends and may infer the presence of additional data or trends from other smart 
5 sensors or from other sensors in the smart sensor array. Additionally, the smart 
sensor can utilize readings from the other smart sensors to essentially create a 
"virtual" sensor that can provide a value that can be utilized in place of the missing 
data. Using its built-in intelligence, the smart sensor can call on other smart 
sensors to assist in sensing an unknown or weak signal object. 

10 The intelligence layer 106, working with the communications layer 104, is 

capable of supporting networked communication with other smart sensors to relay 
information, infer the presence of missing data, yield actionable results based on 
collective weighted inputs from the other smart sensors as a distributed neural 
network. The multisensor data may be integrated and reduced to situation 

IS summaries and action parameters. If desired the processor layer 106 can contain 
flash memory for ease of progranmiing and for removable data storage. 

The intelligence 106 layer may be progranmied to operate the smart sensor 
in a variety of operating modes. The intelligence layer 106 can cause the smart 
sensor module 100 to enter a sleep mode in order to save power. The smart sensor 

20 module 100 may then "wake-up" when the communication layer 104 receives a 
ping or wake-up request. Additionally, the intelligence layer 106 may be 
programmed to operate in a mode where the smart sensor module 100 periodically 
automatically wakes-up and processes data. In another mode, the smart sensor 
module 100 can operate continuously. The intelligence layer 106 may additionally 

25 cause the smart sensor module 100 to operate in an identification/status mode. In 
such a mode, the smart sensor module 100 processes and reports data when 
queried. 

The sensor array layer 108 can include a few or many thousands of 
individual sensing elements 108a (only some of which we speciHcally designated 
30 by reference numerals), permitting multiple parameter measurements in a single 
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unit. Each sensor element 108a or groups of elements 108a can be activated and 
integrated into the intelligence process. Accordingly, in one form, economies of 
scale for manufacturing more sensors than needed for a particular task can be 
utilized to make the smart sensor layer 108 versatile enough to be used on many 
S different applications. As such, the sensor array layer 108 includes the versatility 
necessary to be reconfigurable for sensing biological, chemical and physical 
parameters. Thus, many sensor applications can be constructed from a single 
smart sensor layer 108 via fusible links, firmware and/or on-board software, and 
the applications customized at the time of implementation. Alternatively, smart 
10 sensors may be customized through selective layering techniques at the time of 
fabrication. 

Among other things, the sensor array layer 108 may include optical sources 
(lasers, LEDs, etc.), optical detectors, ultrasonic transducers, physical connectors 
and the interface to perform magnetic activation. Additionally, the sensor array 

IS layer 108 may include appropriate conditioning electronics for the sensors to 

convert outputs into compatible voltages, currents, frequencies, phases or actions 
that can be organized, compared, validated, calibrated, serialized, and analyzed. 
Alternatively or additionally, sensor layer 108 can include one or more other 
sources, detectors, actuators, output devices, and/or input devices. 

20 HG. 3 shows sensing module 1 10 with the basic smart sensor module 100 

of FIG. 2 interfaced with an application specific passive layer 120, including 
features 121. The chemical and biological processing is done on the passive layer 
120, which is preferably disposable. The passive layers can include physical 
connectors, micromolded sensors and/or a moldable microfluidics array. If 

25 desired, the micromolded passive layers can be designed so that it does not include 
wires. For physical measurements, the active components of the sensing 
transducers (e.g. interdigitating leads for strain or pressure, etc.) may be adhered in 
the passive layer to a structure or container being measured. The addition of the 
passive layer 120 and internal software adapts the general purpose smart sensor 

30 module 100 for particular applications. The passive layer 120 is designed to be 
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slide into or attach to the sensing layer 108 and have no electrical connections 
between it and the sensing layer 108. As such, the sensing layer 108 is designed to 
sense the condition or contents of the fluidics or transduction devices on the 
passive layer 120 via non-contact means. The use of a swappable passive layer 
5 120 permits the smart sensor to be modularized and allows for very rapid 
interchange of application specific passive layers 120. 

Referring now to FIGS. 5-7, there is shown an example of an optically 
implemented biosensor using the general purpose smart sensor module 100 and a 
passive layer 120' in conmiunication with the sensor array layer 108. FIG. 5 

10 shows a schematic cross section of the microfluidics channels and optically 

implemented biosensors of the passive layer 120\ As shown, there are a variety of 
ways to se .,e antigen/antibody interactions or DNA using optical sources 1 12a and 
detectors 112b. The passi ve layer 120' of FIGS. 5-7 includes features 121* such as 
optical waveguide biosensors 122, microfluidics channels 123, magnetic controlled 

15 valves 124, 125 and 126, magnetic foam 127 for BEADS and an input port 129. 
The passive layer 120' sits over the sensor array layer 108 of the smart sensor 
module 100. As can be from FIG. 7, sensor module control of the ultrasonic 
agitator 111, optical source 112a and detector 112b, magnetic control valves 114 
and BEAD control 1 17, directly result in application specific functions resulting in 

20 the passive layer 120'. 

Similarly, referring to FIGS. 8 and 9, there is shown an optically 
implemented physical passive layer 120". There are a variety of ways to sense 
physical attributes (temperature, acoustic, strain, etc.) using optical sources and 
detectors. Using the same general purpose smart sensor module as described 

25 above in connection with FIGS. 5-7, different software and a different passive 

layer, physical characteristics of the sensor modules environment can be detected. 
For example, although the same sensor array layer 108 is used to interface with the 
physical passive layer 120" as with the biosensor passive layer 120' of FIGS. 5-7, 
different elements of the sensor array 108 can be selected by the application 

30 specific software to actuate the appropriate optical source and detectors. As shown 


BNSDOCID: <WO 03004975A1_L> 


wo 03/004975 PCT/US02/20908 


13 

in FIG. 9, the temperature sensor 142 interacts with temperature source/detector 
143. Strain sensor 144 interacts with the optical source/detector for strain 145. 
Similarly, the acoustic sensor 146 interacts with the source/detector 147 for the 
acoustic sensor. As noted above, the physical sensor software selects the 
S appropriate optical sources and detectors, which may be different from the sources 
and detectors selected by the biosensor software. Note that the sensor layer 108 is 
configured identically with that of the biosensor application of FIGS. 5-7. 

Referring now to FIG. 10, there is shown a more detailed block diagram of 
one particular embodiment of the general smart sensor system architecture for a 

10 general purpose smart sensor, such as smart sensor 10 of FIG.l or 100 of FIGS. 2- 
4. Note that the particular embodiment of FIG. 10 uses adaptive fuzzy logic as the 
process control component of the system. Additionally, the sample collection and 
preparation stage 150 is a passive layer, such as passive layer 120, 120', or 120". 
Referring now to FIG. 11, there is shown a diagram of one particular 

15 embodiment of the conmiunication system 200 between a plurality of smart sensor 
modules 210, and a remotely located central data management and master control 
node or station 235. Sensor module 210 can be comprised of modules 10, 100, a 
combination of these, or of a different type as would occur to those skilled in the 
art. As shown, the smart sensor modules 210 located in the system 200 may 

20 communicate locally with pico-node controller 215 through either active or 

interrogated RF conununications. Pico-mode controller 215 can be of a dedicated 
type or comprised of one or more of smart sensors 210. In the example of FIG. 1 1 
a pico-network of smart sensor modules 210 use short range RF interrogation to 
conununicate the processed and/or raw data to the pico-node controller 215. In 

25 that same example, a pico-network of smart sensor modules 220 communicates the 
processed data and/or the raw data to the pico-node controller 225 using the 
frequency hopping technique characteristic of the BLUETOOTH standard. 
However, in actuality, one or both of the shown communication techniques may be 
used, or a different conmiunication technique may be used, if desired. The pico- 

30 node controllers 215, 225 transmit the information to the site node controller 230 
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via any of BLUETOOTH, the ffiEE 802.1 lb standard, intermediate range RF. 
fiber, BR or a hardwired communications network, to name just a few. The site 
node controller 230 may communicate with the central network node 235 using 
long range RF, cell phone, satellite links, land lines, fiber-optics, IR links, internet 
5 links, LAN, WAN, or other means of communication* Note that using the 

BLUETOOTH standard, the smart sensor modules can be addressed and address 
each other through the pico-node controller 225 and/or site node controller 230. 

Referring now to FIG. 4, there is shown a smart sensor module system 115 
architecture including an additional process control layer 130 disposed in contact 

10 with the passive layer 120. The process control layer 130 may be utilized in 
connection with the chemical and biological detection schemes that use 
microfluidics to process the samples. As such chemical and biological detection 
techniques that require fluid transfer, manipulation of concentration, and/or 
enhanced specificity of detection can be implemented. The process control layer 

15 130 couples with and controls the micro-fluidics layer via non-contact actuation 
(i.e. electrostatics, magnetics, optics, etc.) controlled preferably by a dedicated 
processor using fuzzy logic, neural control, algorithms or classical control 
methods. 

FIG. 12 is a block diagram showing one specific hardware implementation 
20 of a layered sensor device 300 in accordance with one embodiment of the present 
inventions. The sensor device 300 includes a plurality of sensor inputs 310, which 
may be a physical connector. In the present embodiment, eight inputs are 
provided. The sensor array layer 320 includes analog signal conditioning 322 for 
the eight sensor inputs. Additionally the sensor array layer 320 includes the 
25 process control processor 324, which is controlled by a four bit analog control 

signal from the intelligence layer 330. This process control processor 324 is used 
to control elements in the passive layer, such as the magnetic valves of the example 
of FIGS. 5-7. 

The intelligence layer 330 includes a data conversion stage having a digital- 
30 to-analog converter (DAC) 331 and an analog-to-digital converter (ADC) 332. The 
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eight analog conditioned signals are sampled by the ADC 332. The data 
conversion stage may be implemented using integrated circuits such as the 
TLV1570 and TLV5604, both made by TEXAS INSTRUMENTS. 

The intelligence layer 330 additionally includes a processor 333 to process 
5 the incoming data. In one particular embodiment, the processor 333 is chosen to 
be a 16 bit fixed point digital signal processor, such as the TMSC320VCSS10 
made by TEXAS INSTRUMENTS. Intelligence layer 330 additionally includes a 
system controller 334 for event coordination. The system controller 334 of the 
present embodiment may be chosen to be a 16 bit RISC-type processor, such as the 

10 MSP430 microcontroller, made by TEXAS INSTRUMENTS. The processor 333 
and system controller 334 may share a memory 335 for program and data storage. 
In one particular example, a stacked CSP 3V memory made by INTEL is used. 
Alternatively, each unit may be provided with its own memory. 

A parallel port interface 336 is provided as a programming interface for 

15 downloading application specific software to the sensor device 300 from a host 
computer 338. Alternatively, application specific software may be transmitted to 
the smart sensor from a central station wirelessly, such as by using BLUETOOTH, 
802. 1 lb protocol or other protocols. In this way, smart sensors can be 
reprogrammed for different applications and/or functions very rapidly in the field. 

20 Further, an internal modular serial communication bus is used to connect 

the intelligence layer 330 to the communications layer 340. A high speed 
programmable gain amplifier, such as the PGA202 made by BURR BROWN, may 
additionally be included. 

In the particular embodiment of the present inventions, two different types 

25 of RF communication (active and passive) are shown. This is not meant to be 
limiting, as the inventions can be made with any one or more of the disclosed 
communication systems, or with another system, such as infrared (IR), if desired. 
Communication layer 340 of FIG. 12 includes an active RF communications 
system 344 which, in the present embodiment, is made in accordance with the 
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BLUETOOTH frequency hopping protocol. A passive RFID interrogated tag 
system 346 is additionally provided. 

A power layer 350 is provided. In the present embodiment, a battery 352 is 
provided as the primary power source. The battery 350 may be a 5-9V lithium or 
5 alkaline battery. A battery monitoring circuit 353 provides an alert when the 

charge level of battery 350 is low. Additionally the battery monitoring circuit 353 
monitors the capacity of battery 350 of battery 350 remaining in the power supply. 
An LDO voltage regulator 354 is additionally provided. The LDO voltage 
regulator 354 may be a DSP dual supply. If desired, other voltage supplies 355 

10 (such as parasitic voltage supplies or others described above) may be provided in 
the power module 350. In one embodiment, layers 320, 330, 340, and 350 are 
stacked one on top of the other to provide an integrated form of sensor device 300. 

The smart sensor modules of the present inventions can be used for a 
number of applications. For example, smart sensor modules as described herein 

15 may be particularly useful as pump diagnosticians, health monitors, smart 
heating/cooling systems, water-pump optimizers, smart tags and in smart 
automotive applications. The following examples will be used to demonstrate the 
versatility of and possible applications for the general smart sensor modules 
described herein. 

20 Example 1: Pump Diagnostician 

A smart sensor employed in a pump environment may be set up to detect 
various characteristics of the pump system. For example, the passive layer (120 of 
FIG. 3) may include physical sensors to measure pressure suction/discharge, flow, 
temperature, sound, voltage/current, and/or vibration. Using the inputs from these 

25 sensors, the smart sensor module processor may detect and record anomalies, 
estimate faults and suggest maintenance schedules. Sunmiaries and processor 
suggestions may be wirelessly transmitted continuously or periodically to a remote 
station. As such, processed actionable data derived from the raw data from 
different sensors is sent to the remote station, instead of the raw data that would 

30 need to be processed remotely. Additionally, the smart sensor can determine 
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actions to take, for example, to reduce vibration, and implement them locally 
without outside interaction if programmed to do so. This embodiment permits the 
smart sensor to operate autonomously, semi-autonomously, or in a slave mode 
dependent upon user requirements. 
5 Example 2: Health Monitor 

A smart sensor employed as a health monitor may include a passive layer 
having physical sensors that detect pulse (audio, PPG or ECG sensors), breath 
(audio sensor), respiration (piezoelectric), temperature, blood oxygen (PPG), 
omega waves (long wavelength electrical signals that indicate stress), EEG signals 

10 and/or sweat index (moisture sensor). The smart sensor module can process data 
from the health monitor sensors to detect and record anomalies, calculate daily 
statistics for the patient, calculate total calories, etc. Such a smart sensor module 
could be a standalone module, or could be incorporated into a smart bandage or 
smart belt scanner worn by the patient, a hand held health monitor scanner, a smart 

IS sensor glove or sock or a smart mattress in contact with the patient. 

For example, rather than serving as a wound dressing, a smart bandage may 
include one or more sensors or measuring devices to detect the presence of 
biological fluids, biological agents, genetic material, radiation, color "tags*' for a 
given material or analyte, medication, oxygen, blood gases, red or white blood 

20 cells, temperature, pulse, sound, light or indicia of infection. In addition, the 

detector may comprise an imaging device capable of imaging at least a portion of 
the surface below the smart bandage. The sensors may be present in the smart 
bandage in any practical combination thereof. Additionally the smart bandage may 
further include a component for applying or releasing substances that aid in 

25 fighting infection, reducing scarring or accelerating healing. 

The hand-held medical scanner and belt scanner can additionally include 
ultrasound techniques and other sensors as described in connection with the smart 
bandage. The smart sensor module may send information to a computer for 
display of the wound or ultrasound image on a monitor or television. Additionally, 

30 the smart sensor module could send the information to a personal goggle device. 
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where the information may be displayed in image or textual form at eye level to the 
user. 

Referring now to FIG. 13, there is shown one particular example of a stand- 
alone smart sensor module 3SS including physical connectors in its sensor array 
5 layer to receive the inputs from multiple sensors connected thereto. Sensors 360 
include ECG sensors connected to the smart sensor module 355. Other sensors 
362 are PPG sensors. In the present example, sensors 364 and 366 can be used to 
detect respiration and temperature, respectively. Additionally, sensor 368 may be 
an accelerometer. As shown in HG. 13, in the present example, the sensors 360, 

10 362, 364, 366 and 368 are physically connected to the sensor layer of the smart 
sensor module 355 by electrode leads connected to physical connectors on the 
sensor array layer (108 of FIG. 2) of the smart sensor module 355. Alternatively, 
some or all of the sensors 360, 362, 364, 366 and/or 368 could be fabricated as part 
of the sensor array layer, or affixed as hybrid components to the sensor array layer, 

15 or if using a reconfigurable, general purpose smart sensor module can be affixed to 
or fabricated as part of a passive layer (120 of FIG. 3) in conmiunication with the 
general sensor array layer. The smart sensor module 355 intelligently combines 
the data from the multiple types of sensors and analyzes the data. The processor of 
the smart sensor module 355 can report processed data summaries wirelessly to a 

20 host PC or caretaker via a communications link card 370. This reporting can occur 
when the intelligent processor of the smart sensor module 355 determines by rule 
based analysis that the patient's vital signs indicate the patient is in crisis, or can 
report back when polled by the monitoring station 380, or can be programmed to 
periodically transfer vital statistic summary reports and/or raw data to the 

25 monitoring station 380. 

Example 3: Smart Heating/Cooling System 

A smart sensor module employed in a smart heating or cooling system 
could include a passive layer to detect temperature in/out, humidity, 
voltage/current draw. The smart sensor module can use this information to 
30 automatically adjust the system to maximize comfort through rules learned over 
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time based on behavior or predetermined characteristics. Additionally, the smart 
sensor module can automatically adjust the system to minimize energy usage and 
can suggest maintenance schedules. 

Example 4: Waterpump Optimization 
S A smart sensor module employed in a waterpump optimization system 

could include a passive layer for measuring pressure suction/discharge, flow and 
temperature. Using the sensed information along with the weather forecast data, 
the smart sensor may automatically minimize energy usage for different rate 
structures, alternate pumps to maximize pump lifetime and/or suggest maintenance 
10 schedules. 

Example 5: Smart Tag 

A smart sensor module employed as a smart tag could include a passive 
layer for measuring vibration, temperature and/or humidity. Using the 
information, the smart sensor may automatically detect and record when unsafe 
IS operating conditions occur. The smart sensor module may additionally alert a 
remote station under certain operating conditions. 

Example 6: Automotive Applications 

A smart sensor module employed in automotive applications could include 
a passive layer for measuring pressure, biological signs of the driver, and/or image 

20 data from a rearview mirror. Using the information, the smart sensor may 

automatically position the mirrors, monitor fatigue of the driver and possibly 
provide a wake up alarm, recognize the driver, and/or adjust the seat and/or airbag 
parameters. Additionally a smart oil sensor module could be provided for 
automobiles or small construction equipment. The sensor would be in the 

25 changeable oil filter and could monitor oil characteristics that provide indications 
of engine wear. The module could alert the vehicle operator of the need for an oil 
change. This could be based on detection of threshold level of metal content in the 
oil and/or oil viscosity that indicates the oil is degrading. 

30 


BNSDOCID: <WO ^03004975A1_I_> 


wo 03/004975 


PCTAUS02/20908 


20 

Example 7: Poultry Processing 

A smart sensor module could be used as a pathogen detector in poultry. 
The module could measure and process key environmental factors such as 
temperature, moisture, water quality (chemicals). 
5 Example 8: Smart Package 

Smart sensor modules incorporated into smart packages can measure the 
content and character of a package. It can determine when the package is opened 
and how much content has been removed. It can determine if the character of the 
content is changed or degraded. It can track the location and storage conditions of 
10 the package. Such package parameters can be communicated wirelessly on a 
routine and/or alert basis. Applications for this smart package would include 
storage and use of agrochemical products, fuels and volatile products, and the 
storage of hazardous materials, such as waste, weapons, missiles, etc. 

Example 9: Smart Med-allion 
IS A smart sensor module could be provided that is worn around the neck, 

wrist or on a chest band for continuous monitoring of a patient. Sensors included 
could monitor heart rate, heart rhythm, respiration and/or blood pressure. Data 
could be collected and periodically downloaded to a physician's office and/or 
home computer. If measurements become abnormal, as determined by the smart 
20 sensor module, the wearer would be alerted and a doctor notified. The doctor 

would additionally be provided with an immediate download of information. If it 
became an emergency, the device could be progranmied to dial 911 and an 
embedded GPS receiver would identify the location of the individual. This type of 
smart sensor module application would be useful for people who have heart 
25 conditions, respiratory problems, diabetes or other aliments that require continued 
monitoring but not hospitalization. 

Example 10: Smart Sprinkler System 

A smart sensor module can be employed in agricultural applications and for 
home lawns and gardens. The sensor module could sense moisture and crop or 
30 plant health. Upon local processing of the detected information, the smart sensor 
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module would automatically apply water, and if needed, add fertilizer and 
pesticides/fungicides to the application, as needed. Valves controlled by the smart 
sensor can be used to add liquid fertilizer to a water stream provided by sprinklers. 
Example 1 1 : Determination of Genetic Traits in the Field 
5 Referring now to FIG. 14, there is shown one example of a portable device 

incorporating a smart sensor module capable of sampling and locally analyzing a 
biological sample for the detection and identification of multiple genetic traits. An 
integrated, automated system for testing genetic traits having a processor that 
provides automated feedback to the sample preparation or detection components 

10 within the integrated device is provided. A plurality of sensors provided on the 

smart sensor module samples differing analytes (such as protein and nucleic acids) 
and fuses the data streams into a single information product. This system is 
particularly useful for analyzing genetic traits of crop samples in the field. The 
device 400 of FIG. 14 uses the smart sensor module 410 (similar to 100 of FIG. 2) 

15 and a biological sensor passive layer 420 to perform multiple analyte detection, 
data analysis, and to report the information relating to the results. The system has 
the ability to: (a) process multiple sample types; (b) identify and characterize 
multiple analytes simultaneously; (c) integrate multiple sensor devices in 
subsystems; (d) integrate and fuse data streams from multiple sensors into an 

20 information product; and (e) conmiunicate data wirelessly. Sensor module 410 

including the biosensor passive layer 420 has applicability to a variety of systems, 
with detection of genetic traits, such as nucleic acid sequences, proteins and 
chemicals, such as lycopene and Vitamin A, in agricultural products. 

Note that all of the above smart sensor module applications can be made 

25 using the general smart sensor module described in connection with FIG. 2 by 
providing application specific software and an application specific sensor array 
passive layer. Other smart sensor module applications such as smart labels, 
inventory control and supply systems, condition tracking and alert systems, 
machine prognostics, smart appliances, smart houses, pulmonary drug delivery 

30 monitoring, wellness watch services and critical care alerts can be provided using 
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the general smart sensor module by adapting the software and passive layer sensor 
suites to the particular application. Other physical and biological smart sensor 
applications possible with the above inventions include blood pathogen detection, 
POC medical diagnostics, medical monitoring pill, food pathogen detection, water 
5 pathogen detection, veterinary medicine, biological threat detection and/or non- 
invasive blood chemistry testing. Additional physical/chemical/biological smart 
sensor applications possible with the above inventions include, drug efficacy 
monitoring, medical ventilator monitoring, crop health monitor and/or smart patch 
medical emergency diagnostics. Further, it should be understood for sensor 

10 module/device embodiments that are reconfigurable, a corresponding number of 
different configuration programs can be resident in the module or device with 
manual and/or automatic selection or "activation" of the appropriate program being 
provided. Alternatively or additionally, the module can be reprogranmied with 
each configuration change. 

15 Many further embodiments of the present inventions are envisioned. For 

example in other embodiments, the layers, sensor types, module types, and the like 
can be combined or interchanged. In another example, a layer including one or 
more actuators is provided that is responsive to information processed from one or 
more sensors. In still another example, a sensor module comprises: a wireless 

20 conrmiunication device; at least two sensors each operable to sense a different 

characteristic and provide corresponding sensor signals; a processor operable to 
provide information determined from the sensor signals in accordance with an 
adaptive learning routine; and a power source operatively coupled to and carried 
with the wireless communication device, the sensors, and the processor. For one 

25 form of this embodiment, the adaptive learning routine includes an algorithm based 
on at least one of the group consisting of: a self-organization feature map, adaptive 
resonance theory, a feed forward neural network, a recurrent neural network, and 
Hopfield and bi-directional associative memory learning. Alternatively or 
additionally, the power source, the wireless communication device, and the 

30 processor each correspond to one of three different layers coupled together to 
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provide an integrated sensing subassembly; and/or may include one or more 
interchangeable passive layers. 

In yet another example, an apparatus comprises: a sensor module with at 
least two sensors each operable to sense a different characteristic and provide 
S corresponding sensor signals; a processor operable to provide sensor module 
location information determined from the sensor signals in accordance with an 
adaptive learning routine; and a wireless conmiunication device operable to 
transmit the location information. For one form of this embodiment, the adaptive 
learning routine includes an algorithm based on at least one of the group consisting 

10 of: a self-organization feature map, adaptive resonance theory, a feed forward 
neural network, a recurrent neural network, and Hopfield and bi-directional 
associative memory learning. Alternatively or additionally* the power source, the 
wireless conmiunication device, and the processor each correspond to one of three 
different layers coupled together to provide an integrated sensing subassembly; 

IS and/or may include one or more interchangeable passive layers. 

Still another example comprises: performing a first sensing application 
with a sensing device, the sensing device including a power source, a processor, a 
wireless communication device, a first layer to perform sensing with two or more 
sensors each of a different type, and a memory including first application 

20 programming corresponding to one or more features of the first layer; 

interchanging the first layer of the sensing device with a second layer, the second 
layer including at least one feature different from the one or more features of the 
first layer, the memory including second application programming corresponding 
to the at least one feature of the second layer; and performing a second sensing 

25 application with the sensing device after the interchange, the second application 
being different than the first application. 

A further example comprises: providing a plurality of sensing device 
subassemblies each including a power source, a processor, a wireless 
communication device, and two or more sensors each of a different type; coupling 

30 a first outer layer to one of the subassemblies to provide a sensing device for a first 
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application; coupling a second outer layer to another of the subassemblies to 
provide a sensing device for a second application different than the first 
application; and executing a first program with the sensing device for the first 
application and a second program with the sensing device for the second 
5 application, the first program and the second program being at least partially 

different in accordance with a difference between features of the first outer layer 
and the second outer layer. 

Yet a further example comprises: providing a self-powered, remote sensor 
module carrying at least two sensors each operable to sense a characteristic of a 

10 different type and a wireless communication device; processing signals from the 
sensors with a neural network provided by the sensor module; and transmitting 
information from the sensor module with the wireless communication device, the 
information being at least partially determined from said processing. 

Another example includes: providing a self-powered, remote sensor 

15 module carrying at least two sensors each operable to detect a characteristic of a 
different type; carrying the sensor module with a mobile person and/or a mobile 
object; processing signals from each of the sensors with an adaptive learning 
routine executed by the sensor module; and providing location information for the 
mobile person and/or the mobile object at least partially based on such processing. 

20 In a further example, a sensor module is included that comprises: means 

for providing the sensor module in a number of layers coupled together to provide 
an integrated sensing unit with at least an outer one of the layers being 
interchangeable; means for sensing at least two different characteristics and 
providing corresponding sensor signals that is coupled to an outer one of the 

25 layers; means for processing the sensor signals with an adaptive learning routine; 
and means for wirelessly communicating information from the processing means 
to a receiving device. 

While the inventions have been illustrated and described in detail in the 
drawings and foregoing description, the same is to be considered as illustrative and 

30 not restrictive in character, it being understood that only the preferred 
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embodiments have been shown and described and that all equivalents, changes, 
and modifications that come within the spirit of the inventions described herein 
and by the following claims are desired to be protected. 
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What is claimed: 

1 . A modular general purpose sensor unit, comprising: 

a sensor array layer to receive and condition data from at least two different 
5 types of sensor; 

a general purpose intelligent processor and control layer to process at least 
said conditioned data and produce output data derived from said conditioned data, 
said processor and control layer including a reprogrammable memory for storing 
application specific software to control the operation of said processor and control 
10 layer, said output data being at least partially different from said conditioned data; 

a power layer for providing power to said sensor airay layer and said 
processor and control layer; 

wherein said sensor array layer, said processor and control layer, and said 
power layer are layered to form a sensor module. 


15 


20 


2. The modular general purpose sensor unit of claim 1 , further 
comprising a conmiunications layer for transmitting and receiving information to 
and from said sensor module, said sensor module including said communications 
layer. 

3. The modular general purpose sensor unit of claim 2, wherein said 
sensor module includes a data port for receiving application specific software to be 
stored in said memory. 

4. The modular general purpose sensor unit of claim 2, wherein said 
memory can be programmed to perform a different application with application 
specific software received by said communications layer. 
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5. The modular general purpose sensor unit of claim 2, wherein said 
communications layer receives other sensor output data from another sensor 
module. 


5 6. The modular general purpose sensor unit of claim 2, further 

comprising a removable passive layer including a plurality of types of sensors 
thereon, said removable passive layer being configured for a specific application, 
said removable passive layer further adapted to be placed in communication with 
said sensor array layer of said sensor module. 

10 

7. The modular general purpose sensor unit of claim 6, wherein said 
smart sensor module can be reconfigured for a different application by replacing 
said removable passive layer with a second removable passive layer adapted to a 
second specific application and reprogranmiing said memory with second software 
IS adapted to said second specific application. 


8. The modular general purpose sensor unit of claim 6, wherein said 
passive layer includes microfluidics channels and further comprising a process 
control layer to control fluid flow through said microfluidics channels on said 

20 passive layer by non-contact actuation. 

9. The modular general purpose sensor unit of claim 6, wherein said 
output data is used by said sensor module to adjust a parameter being monitored. 

25 10. The modular general purpose sensor unit of claim 1, wherein said 

two different types of sensors are chosen from a group including sensors that 
respond to temperature, pressure, vibration, electric fields, magnetic fields, optical 
irradiation, particle radiation, thermal radiation, momentum, acceleration, shock, 
flow, viscosity, density, mass, shear strain, conductivity, impedance, sound, 

30 ultrasound, specific organic elements, inorganic chemical elements, inorganic 
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chemical compounds, inorganic chemical complexes in liquid gas, inorganic 
chemical in solid phases, proteins, enzymes, antigens, antibodies, other DNA 
fragments, genes and olignonucleotides. 

5 11. The modular general purpose sensor unit of claim 10, wherein said 

two different types of sensors are included on a removable passive layer in 
conmiunication with said sensor array layer of said unitary smart sensor module. 

12. A sensor conmiunication network, comprising: a plurality of 
10 general purpose smart sensor devices, each comprising: 

a sensor array layer to receive and condition data from at least two different 
types of sensor; 

a general purpose intelligent processor and control layer to process at least 
said conditioned data and produce output data derived from said conditioned data, 
15 said processor and control layer including a reprogrammable memory for storing 
application specific software to control the operation of said processor and control 
layer, said output data being at least partially different from said conditioned data; 

a power layer for providing power to said sensor array layer and said 
processor and control layer; 
20 wherein said sensor array layer, said processor and control layer, and said 

power layer form a sensor module; 

a central station for receiving said data; and 

wherein said output data from each of said smart sensor devices is 
communicated to said central station. 

25 

13. The sensor conimunication network of claim 12, additionally 
including: 

a plurality of node controllers, each node controller interacting with a 
portion of said plurality of general purpose smart sensor devices; and 
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at least one site node controller in communication with said plurality of 
node controllers and with said central station. 

14. The sensor conununication network of claim 13, wherein at least a 
5 portion of said smart sensor devices conmiunicate with at least one of said node 
controllers using a conmiunication system chosen from the group including: the 
BLUETOOTH protocol, active RF conmiunications and passive RF 
communications. 

10 15. The sensor conmiunication network of claim 13, wherein at least a 

portion of said node controllers communicate with said site node controller using a 
communication system chosen from the group including long range RF, cell phone, 
satellite link, land wire, fiber optics, IR links, internet links. 

15 16. A method, comprising: 

performing a first sensing application with a sensing device, the sensing 
device including a power source, a processor, a wireless communication device, a 
first layer to perform sensing with two or more sensors each of a different type, 
and a memory including first application programming corresponding to one or 

20 more features of the first layer; 

interchanging the first layer of the sensing device with a second layer, the 
second layer including at least one feature different from the one or more features 
of the first layer, the memory including second application programming 
corresponding to the at least one feature of the second layer; and 

25 performing a second sensing application with the sensing device after said 

interchanging, the second application being different than the first application. 

17. The method of claim 16, wherein the power source, the processor, 
and the wireless communication device are each carried on a different one of a 
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number of layered carriers coupled together to provided an integral sensing 
subassembly. 

18. The method of claim 16, which includes wirelessly communicating 
5 first information from the sensing device for the first sensing application and 

second information from the sensing device for the second sensing application. 

19. The method of claim 16, wherein the sensors are carried in a sensor 
layer and said providing includes reprogranmiing the memory before said 

10 performing the second sensing application. 

20. The method of claim 19, wherein the first layer is in the form of a 
first passive layer that cooperates with the sensor layer to provide a first sensing 
configuration and the second layer is in the form of a second passive layer that 

15 cooperates with the sensor layer to provide a second sensing configuration. 

21. The method of claim 16, which includes processing information 
from the sensors with a neural network. 


20 22. A method, comprising: 

providing a plurality of sensing device subassemblies each including a 
power source, a processor, a wireless communication device, and two or more 
sensors each of a different type; 

coupling a first outer layer to one of the subassemblies to provide a sensing 
25 device for a first application; 

coupling a second outer layer to another of the subassemblies to provide a 
sensing device for a second application different than the first application; and 

executing a first program with the sensing device for the first application 
and a second program with the sensing device for the second application, the first 
30 program and the second program being at least partially different in accordance 
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with a difference between features of the first outer layer and the second outer 
layer. 

23. The method of claim 22, wherein said first outer layer and said 
S second outer layer are each passive. 

24. The method of claim 22, which includes performing an actuation 
with the sensing device. 

10 25. The method of claim 22, wherein the power source, the processor, 

the wireless communication device, and the sensors are each carried on a different 
one of a corresponding number of layered carriers coupled together for each of the 
subassemblies. 

IS 26. The method of claim 22, wherein the first program includes an 

adaptive learning routine. 

27. The method of claim 22, wherein the first outer layer includes 
microfluidics channels and which includes controlling fluid flow through the 

20 microfluidics channels by noncontact actuation. 

28. A method, comprising: 

providing a self-powered, remote sensor module carrying at least two 
sensors each operable to sense a characteristic of a different type and a wireless 
25 conununication device; 

processing signals from the sensors with a neural network provided by the 
sensor module; and 

transmitting information from the sensor module with the wireless 
conununication device, the information being at least partially determined from 
30 said processing. 
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29. The method of claim 28, wherein the sensor module includes a 
processor defining the neural network. 

5 30. The method of claim 28, wherein the sensor module comprises a 

first layer including a power source, a second layer including the wireless 
communication device, a third layer including the processor, and a fourth layer 
including the sensors, 

10 31. The method of claim 28, wherein the sensor module is one of a 

plurality of the sensor modules in wireless communication with a node. 

32. The method of claim 28, which includes locating an object or 
person carrying the sensor module. 

15 

33. A method, comprising: 

providing a self-powered, remote sensor module carrying at least two 
sensors each operable to detect a characteristic of a different type; 

carrying the sensor module with one or more of a mobile person and a 
20 mobile object; 

processing signals from each of the sensors with an adaptive learning 
routine executed by the sensor module; and 

providing location information for the one or more of the mobile person 
and the mobile object at least partially based on said processing. 

25 

34. The method of claim 33, wherein the adaptive learning routine 
includes an algorithm based on at least one of the group consisting of: a self- 
organization feature map, adaptive resonance theory, a feed forward neural 
network, a recurrent neural network, and Hopfield and bi-directional associative 

30 memory learning. 
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35. The method of claim 33, wherein the sensor module includes a 
processor defining a neural network that executes the adaptive learning routine. 

5 36. The method of claim 33, wherein the sensor module comprises a 

first layer including a power source, a second layer including a wireless 
communication device, a third layer including a processor, and a fourth layer 
including the sensors. 

10 37. The method of claim 36, wherein said providing includes wirelessly 

transmitting the location information with the wireless communication device. 

38. The method of claim 33, wherein the sensor module is carried with 
the mobile object and the mobile object is in the form of a package. 

15 

39. The method of claim 33, wherein the sensor module is carried with 
the person and the sensor module detects one or more medical parameters of the 
person. 

20 40. A self-powered, sensor module, comprising: 

means for providing the sensor module in a number of layers coupled 
together to provide an integrated sensing unit with at least an outer one of the 
layers being interchangeable; 

means for sensing at least two different characteristics and providing 
25 corresponding sensor signals, said sensing means being coupled to said outer one 
of the layers; 

means for processing said sensor signals with an adaptive learning routine; 

and 

means for wirelessly communicating information from said processing 
30 means to a receiving device. 
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